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(54) System and method for determining quality of printed matter 



(57) An apparatus and method for determining print 
quality of a printer wherein printed matter is control! ably 
presented to an optical transducer unit wbich scans 
user or machine selected areas of said printed matter to 
generate a signal that is processed by a processing unit 
to determine print quality. The processing unit proc- 
esses the signal in an efficient and rapid three step 
method in which the signal produced by the transducer 
unit is modified and segmented to determine general 



characteristics, recognized by a recognition engine and 
finally checked for voids, spots, blobs or the like. The 
invention provides an operator with the ability to set 
quality thresholds such as an acceptable number of 
quality defects in a single scan. If the number of quality 
defects exceeds the user input quality limit, the proces- 
sor unit determines that the printed matter is poor qual- 
ity and may cause the printer to cease printing. 
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Description 

HELP OF THE INVENTION 

The present invention relates generally to a system 5 
and method for determining the quality of a high speed, 
electronic printer's output. More particularly, the present 
invention relates to a system and method for in-line 
monitoring of such a printer's output in order to verify 
that selected printed matter meets certain quality stand* w 
ards. 

BACKGROUND OF THE INVENTION 

Many computer printing applications require the is 
use of high speed, high volume printers. Typical exam- 
ples include personalized letters, invoices, checks, 
direct marketing solicitations and the like. Computer 
printing operations generally include a high speed elec- 
tronic printer coupled with other support devices such 20 
as feed mechanisms which direct paper or other stock 
into and out of a printer. These operations also fre- 
quently have post-printing devices or mechanisms that 
perform additional operations such as cutting and trim- 
ming, folding the printed matter, inserting the printed 25 
matter into envelopes, or sorting. 

Currently, computer printing operations are not as 
fully automated as is desirable for maximum efficiency. 
Ideally, the printer and its associated intelligence, as 
well as all post-printing operations, operate with as little 30 
human interaction as possible. The benefits of automa- 
tion over human operators are well known. For repetitive 
tasks such as folding and inserting printed matter into 
envelopes, automated machines performing these 
tasks are generally faster, more reliable, and less costly 35 
than human operators performing the same tasks. 

Human operators, however, are still required to 
supervise the automated equipment for a variety of rea- 
sons. Mechanical failures are one class of problems 
associated with automated equipment requiring human to 
supervision. For example, if a paper feed mechanism 
becomes jammed or otherwise mechanically disabled, 
a human operator must be -available to correct the prob- 
lem and restart the job. Poor print quality represents 
another class of problems that historically has required «s 
human supervision to detect and correct. That is. 
human operator are required to periodically verify the 
print quality of the electronic printer to insure that the 
printer is accurately performing its job in a proper loca- 
tion and without introducing other printing defects such so 
as extraneous toner (dry ink), streaks, smears, partial 
prints or failure to print at all. 

Developers of computer printing equipment have 
continued to improve and refine their designs to reduce 
the occurrences of mechanical failures and thereby ss 
reduce human interaction. Consequently, the mecha- 
nisms associated with electronic printers have 
improved. The problems associated with quality, how- 
ever, are less amenable to solution because of differing 



perspectives on the definition of quality and a potential 
for varied responses to quality degradation as printer 
quality diminishes. Although developers are constantly 
striving for improvements, printers still have many prob- 
lems which result in poor output quality. 

High quality printing is an extremely important 
aspect of most computer printing operations. If errors 
occur during the printing process, a potentially serious 
ripple effect can occur. For example, if a mailing opera- 
tion is printing and sending invoices, such as telephone 
bills, to a large number of customers, poor print quality 
may cause erroneous or illegible invoices to be sent to 
hundreds or perhaps even thousands of customers. 
Moreover, even if the invoices that are sent to the cus- 
tomers are sufficiently legible to be read by humans, 
these invoices may not be of sufficient quality to be read 
by remittance processing machines, resulting in costly 
manual processing. Thus, in those cases, such as tele- 
phone bills, which have portions of the printed matter 
that wilt ultimately be read by machines, print quality is 
extremely important. 

Print quality is also becoming more important for 
purely aesthetic reasons. Businesses and organizations 
such as banks, insurance companies, public utilities, 
mail order retailers and the like have determined that 
their primary contact with their customers is made 
through the mail. Thus, the image portrayed to the cus- 
tomers is highly dependent upon the quality and nature 
of the mail items sent. Maintaining a good image with 
customers is of vital importance to such businesses, 
particularly where the business is based on customers' 
trust and confidence. A mailing rife with defects and 
poor print quality would lend to portray an image of 
incompetence and would undermine customers' confi- 
dence. 

Detecting flaws in print quality is therefore pivotal to 
the success of most printing operations. Moreover, the 
rapid detection of printing flaws is also important to the 
success of computer printing operations. If a printing 
flaw is detected only long after the job has been printed, 
the job will have to be reprinted and. possibly, put other 
print jobs out of sequence to accommodate the reprint- 
ing. Additionally, a relatively minor and easily correcta- 
ble printing flaw, such as low toner, may dramatically 
affect the quality of a large print job and, in turn, may 
require the entire print job to be reprinted at considera- 
ble expense. 

To reduce or prevent these occurrences, human 
operators have historically checked print quality by peri- 
odically stopping the automated printing process and 
examining the printed matter for quality. This solution to 
quality checking, however, is inadequate. Modern auto- 
mated computer-controlled printers print at an 
extremely high rate when compared to older technology. 
In some instances, such modern printers print at 250 
pages per minute or even faster. With costly devices 
printing at such high printing speed, it is important. to 
reduce printer interruptions even for small amounts of 
time. Consequently, operators of computer printing 
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operations are reluctant to frequently inspect the print- 
ing quality. Moreover, human operators sometimes tail 
to detect quality problems due to simple negligence or 
due to a lack of sufficient time to inspect the printing. 
Finally, it is inefficient to require a human operator to 
watch over a high quality print job if. as in most cases, 
there is no problem with the printing. 

OBJECTS AND SUMMARY OF THE INVENTION 

It is therefore the genera! object of the present 
invention to provide a quality verification system and 
method that accurately determines the quality of varia- 
ble printed matter. 

It is another object of the invention to implement a 
quality verification system and method that requires 
minimum human interaction. 

It is another object of the invention to implement a 
quality verification system and method that can be eas- 
ily integrated into existing computer printing operations. 

Yet another object of the invention is to provide a 
quality verification system and method that can verify 
data content as well as the quality. 

it is a further object of the invention to permit easy 
access by a user to select areas to be inspected and to 
set quality standards or limits for these areas. 

Another object of the invention is to adapt to chang- 
ing conditions in order to differentiate between ordinary 
environmental changes and serious print quality prob- 
lems. 

It is a further object of the invention to provide a 
system and method that interfaces with the printer in 
order to control the printer. 

A related object of the invention is to provide a sys- 
tem with a quality system processing unit which is capa- 
ble of requesting information and passing information to 
a printer interface. 

Lastly, it is an important object of the invention to 
predict and detect quality changes in the printed matter. 

The foregoing and other objects and advantages 
are accomplished by the present invention which 
includes a system and method that receives output from 
a printer, scans selected areas of the printed matter, 
analyzes the output for quality through a recognition 
system, and transmits the printed matter out of the sys- 
tem. An operator, through a console, selects areas of 
the printed matter to analyze and also inputs quality lim- 
its or thresholds for the system and method to use when 
comparing scanned data with benchmark data. The 
system and method may receive print information from 
a printer interface including the data that is being printed 
and the location of the data. 

In one preferred embodiment, the system and 
method analyzes the scanned data by segmenting the 
data into characters and then performing three levels of 
quality checks. A first level check is a fast low level veri- 
fication that the printed characters are properly posi- 
tioned and have proper print characteristics. A second 
level check more stringently verifies the font and charac- 



ter. A third level check verifies the quality of the printed 
matter by inspecting for print defects such as spurious 
spots, voids and streaks caused by low toner or printer 
malfunction. If the system and method detects a failure 
5 of any single level, it logs an error in a file and possibly 
stops the print job. The user has the ability to input the 
criteria for the system and method to cause the printer 
to cease printing. 

w BRIEF DESCRIPTION OF THE DRAWINGS 

FIGURE 1 is a block diagram showing the compo- 
nents of a preferred embodiment of the invention and 
their interconnections. 
is FIG. 2 is a schematic diagram of the pathway of a 
representative roll of printed matter as it is being read by 
an optical transducer. 

FIG. 3A is an illustration of a representative page of 
printed matter to be inspected. 
20 FIG. 3 B is an illustration of an area of FIG. 3 A that 
represents high quality printing. 

FIGS. 3C-3E are illustrations of the same area of 
FIG. 3A that represent various printing problems result- 
ing in low quality printed matter. 
25 FIG. 4 is a flow diagram illustrating the steps taken 
by a preferred embodiment of the invention. 

FIG. 5 is a flow diagram illustrating the steps of a 
preferred embodiment of the invention to be used to 
determine print quality of printed matter. 
30 FIGS. 6A-6C are illustrations of a single character 
analyzed in conformity with a preferred embodiment of 
the invention. 

FIG. 7A is an illustration of an alternative represent- 
ative printed page to be inspected in accordance with 
35 the invention. 

FIGS. 7B-7C are expanded views of FIG. 7A show- 
ing specific areas to be inspected in accordance with 
the invention. 

FIG. .8 is a block diagram illustrating a preferred 
40 physical arrangement of a preferred embodiment of the 
invention. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENT 

45 

Fig. 1 is a block diagram of a preferred embodiment 
of the invention. Fig. 1 may represent the invention in a 
typical computer printing environment. Fig. 1 includes a 
print engine 1. a roll or sheet feeder mechanism 6, an 

so optical transducer unit 12, an exit roll or sheet feeder 
mechanism 26. and a quality system processing unit 
("QSPU") 18. 

Print engine 1 includes a printer 2 and a printer 
interface 4. Printer 2 may be fed paper by a continuous 

55 roll feeder (not shown). Printer 2 and interface 4 are 
communicatively coupled through appropriate cabling 
and other hardware as well as through any appropriate 
and necessary software such as protocol stacks. The 
connection between printer 2 and interface 4 is sche- 
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matically illustrated as a two way connection 3. Two way 
connection 3 illustrates that printer 2 and interface 4 can 
both send and receive information. In one preferred 
embodiment, printer 2 of print engine 1 is a typical high 
rate printer such as an IBM Pennant Systems 3900 s 
printer. This is a high speed non-impact type printer that 
is well suited for operation in a large scale computer 
printing operation. ' . 

Interface 4 of print engine 1 may be any printer 
interface. In one embodiment printer interface 4 is 10 
capable only of basic control over printer 2 and provid- 
ing such functions as starting and stopping the printer 
and providing status information such as printer out-of- 
paper or printer stopped. In an alternative embodiment, 
printer interface 4 is an "intelligent interface" capable of js 
receiving and transmitting specific information regard- 
ing the print job to other devices. For example, print 
interface 4 may provide information about the data 
being printed and its physical printed location. Printer 
.. interface 4 may also be a stand-alone computing device 20 
and may entirely control the printer 2 or it may only be a 
means for the printer to communicate control signals. 
Thus, printer interface 4. as contemplated by the inven- 
tion, provides a function that may be implemented in 
many different modes. ' 2s 

In the intelligent printer interface embodiment, 
printer interface 4 is able, at least, to provide access to 
information, in some form, regarding the data**- being 
printed and the orientation and coordinates of thaj data 
on the printed page. In this embodiment, printer inter- 30 
face 4 may receive information from print sources (not 
shown) which provide further input, data or instructions 
regarding the print job. 

Printer interface 4. while represented as a separate 
component from printer 2. need not be physically sepa- 35 
rated from printer 2. In any embodiment, printer inter- 
face 4 should be able to provide or relay important 
instructions, such as stop or start print commands, to 
the printer based on communications with QSPU 18. 

Printer interface 4 communicates with the QSPU <o 
through a two way connection that is schematically illus- 
trated as connection 25. As in the case of connection 3, 
connection 25 schematically represents all necessary 
hardware, such as cabling and/or a network interface, 
and ail necessary software, such as protocol stacks, to <s 
establish a communication link between print engine 1 
and QSPU 18. Connection 25 may represent a direct 
connection, such as a serial interface, or it may repre- 
sent a local area network ("LAN") connection, a wide 
area network connection or any other electrical connec- so 
tion that is capable of carrying data between two nodes 
or sites. 

Printed matter is printed by print engine 1 and is 
physically transmitted to a roll or sheet feeder mecha- 
nism 6 via pathway 5. Pathway 5 is schematically ill us- 55 
trated in Fig. 1. Physically, pathway 5 includes all 
necessary rollers, platens and motors to guide the 
sheets or web of printed matter to feeder 6. As printer 2 
prints a job, the printed matter is sent to roll or sheet 



feeder 6. Roll or sheet feeder 6 may handle either dis- 
crete sheets 7 of printed matter or the web of a roll £ of 
printed matter. In one preferred embodiment feeder 6 is 
dedicated to roll-fed printed matter which is received 
from printer 2 on the same roll. 

Roll or sheet feeder 6 serves to align printed matter 
received from pathway 5 and printer 2 and to present 
the printed matter to optical transducer unit 1 2. Optical 
transducer unit 12 includes at least one optical trans- 
ducer 1 4 which is capable of scanning a discrete area of 
printed matter, schematically illustrated in unit 12 as 
printed matter 13. Optical transducer unit 12 may also 
include additional transducers, such as transducer 1 6. 
This second optical transducer may be employed to pro- 
vide processing of offset printed matter. Optical trans- 
ducer unit 12 may also include four or more optical 
transducers in order to permit "two-up" processing of 
printed matter. Two-up processing is a term known in 
the art and refers to processing two separate print oper- 
ations at the same time, usually side-by-side on a single 
web. Two-up processing may be more efficient than sin- 
gle processing. 

Additional optical transducers may also be 
employed to provide full duplex scanning of printed mat- 
ter. In the art. printed matter on only one side of a page 
is known as simplex printing, and printed matter printed 
on both sides of a page is known as duplex printing. To 
scan duplex printing, optical transducers are used to 
scan both sides of the web or sheet. Thus, the invention 
fully contemplates that unit 12 has as many additional 
transducers as necessary to implement the appropriate 
quality verification in either simplex or duplex scan 
mode. 

Optical transducer 14 may be a CCD array, an LED 
array, a vidicon, a laser, or any other suitable optical 
means operative to produce electrical signals repre- 
sentative of the selected area of the printed matter. 
Preferably, transducer 14 is a CCD array having cells 
extending in one dimension perpendicular to the direc- 
tion of motion of the printed matter 13. The transducing 
unit 12 is operatively coupled to appropriate associated 
hardware and software schematically illustrated as 
block 15. This hardware and software is necessary to 
permit transducer 1 4 and/or transducer 1 6 to focus on 
appropriate areas of the printed matter and to obtain an 
image of the printed matter. Block 15 represents hard- 
ware such as focussing circuits, triggers, frame grab- 
bers, signal processing circuits and all necessary 
software to operate this hardware and transducer 16. 
These items are well-known and selection of such com- 
ponents may be optimized by a person of ordinary skill 
in the art for a particular application. 

Optical transducer unit 12 is communicatively cou- 
pled to QSPU 18 via two way connection 17. As in the 
case of other connections, connection 15 includes all 
necessary hardware and software components to 
ensure data communications between the transducing 
unit 12 and the QSPU 18. 

Optical transducer unit 12, through transducer 14 
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and hardware and software 15, is capable of focussing 
on a select area of printed matter. In a preferred embod- 
iment, the transducer, such as transducer 14, focuses 
on a select area based on data supplied by QSPU 18 
over communication connection 1 7. Many camera sys* $ 
terns and scanner hardware well known in the art have 
the capability to focus on specific physical areas within 
a coordinate system. The ability of the preferred optical 
transducer to focus, however, should not be construed 
to mean that the transducer must focus on an area less jo 
than the entire printed sheet or the width of the entire 
printed roll. 

As noted above, optical transducer unit 1 2. through 
representative transducers 14 and 16. operates to scan 
printed matter 13 and generate an electrical signal rep- is 
resentative of the scanned areas of the printed matter. 
Thereafter, the electrical signal is transmitted via com- 
munication link 17 to QSPU 18 for further analysis. It is 
noted that transducer hardware 15 may provide addi- 
tional circuitry to digitize the electrical signal prior to 20 
transmission to QSPU. 18 or transducer hardware 15 
may simply transmit an analog signal to QSPU 18 
where it is later digitized. Both techniques are well 
known to persons of ordinary skill and either embodi- 
ment is permissible and within the scope of the inven- 25 
tion. 

After receiving the optical transducer signals, 
QSPU 18. among other things, processes the electrical 
signals to determine quality of the printed matter. QSPU 
1 8 includes an inpuVoutput status console 24. a proces- 30 
sor 1 9, at least one type of memory 22 communicatively 
coupled to processor 1 9 through two way connection 23 
and a recognition engine 20, including appropriate data 
structures or methods, communicatively coupled to 
processor 1 9 through two way connection 21 . 35 

The QSPU components schematically illustrated in 
Fig. 1 are not intended to limit the QSPU to only those 
components. Indeed, it is appreciated by a person of 
ordinary skill that QSPU 18 also may require or utilize 
components which are not illustrated such as power <o 
supplies, an operating system, a network interface, a 
floppy or soft disk drive, a hard disk drive, CD-ROMs 
and CR-ROM drives, appropriate hardware and soft- 
ware drivers, read only memory, random access mem- 
ory, input and output ports, an expansion bus, 45 
miscellaneous peripherals and the like. 

Input/output status console 24 of QSPU 18 includes 
a display monitor and a keyboard or other input means, 
such as a touch screen or mouse, and is the means to 
permit operator input to QSPU 1 8 and to permit QSPU so 
18 to output information to an operator. Through status 
console 24, a user can input information and instruc- 
tions to QSPU 18 regarding, among other things, error 
limits on the number of acceptable detected quality 
problems of the printed matter. The user can also select ss 
the area of the printed matter to analyze for quality. 
These user instructions and data may be stored in 
memory 22 of QSPU 18 which represents storage in 
either random access memory ("RAM") or in other 



memory such as a hard disk drive or magnetic tape. In 
a preferred embodiment, the status console 24 displays 
a graphical user interface ("GUI") to assist the input and 
output of data and instructions. 

Status console 24 through its associated monitor 
and GUI. is capable of providing information to operators 
regarding the printed matter. Status console 24 may 
perform such operations as graphically displaying 
printed matter being scanned or previously scanned by 
transducer unit 12. Status console 24 may also permit 
the user to review a history of quality problems. Addi- 
tionally, status console 24 may also include alternative 
annunciators, other than a monitor, to warn human 
operators. Thus, status console 24 may include dedi- 
cated flashing lights or sirens or may even include a 
wireless paging system to inform operators outside the 
immediate physical vicinity of the printer that the printer 
is undergoing quality problems. Status console 24 may 
be a console dedicated to the QSPU 18 or it may be a 
console that further serves as" a user interface for other 
mailroom functions, such as printing, sorting, post -fin- 
ishing, etc. Indeed, the entire QSPU 18 may comprise 
hardware shared with such other mailroom functions. 

Memory 22 of QSPU 18.may include memory such 
as random access memory, hard disk drives, floppy disk 
drives, CD-ROM disk drives, tape drives, optical storage 
devices, or any other suitable memory means, in a pre- 
ferred embodiment, memory 22 includes at least 8 meg- 
abytes of random access memory, at least one floppy 
disk drive, and at least one hard disk drive of at least 
1 00 megabytes of storage capacity. 

Processor unit 19 of QSPU 18 may be any comput- 
ing machine or data processing unit that is capable of 
executing instructions which are stored in QSPU 18 
memory. In a preferred embodiment, QSPU 18 employs 
an Intel® type complex instruction set processor such 
as a Pentium® processor or a 486 processor and all 
associated hardware. In a preferred embodiment. 
QSPU 18 also utilizes a well known operating system 
such as Microsoft Windows® or IBM OS/2 Warp®. 
However, as processor technology is improved, it is 
expected that other processors including reduced 
instruction set processors and parallel processing units 
may be employed without departing from the scope of 
the invention. The functionality of processor unit 19 may 
be merely one of many tasks performed by a processor 
having oversight and control of multiple mailroom func- 
tions. 

QSPU 18 also , has a recognition engine 20. 
accessed through a data structure located in memory, 
that is used to resolve the image signals from trans- 
ducer unit 12 into further electrical signals representa- 
tive of the information content of the printed matter. 
Electrical signals produced by optical readers or trans- 
ducers, such as those in transducer unit 12, are signals 
representative of the image of printed matter and not 
the content or quality of the printed matter. Thus, to pro- 
duce further electrical signals representative of the con- 
tent of printed matter, a recognition engine, such as 
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engine 20, is utilized. Recognition engine 20 may be 
construed as either all necessary hardware and data 
structures implementing stored instructions or as the 
steps performed by hardware and/or data structures. 

Recognition engine 20 may employ various recog- 
nition techniques. Many techniques are known in the 
art. United States Patent 5.057,088. assigned to the 
assignee of the present invention, and United States 
Patents 5.381,489. 5.369,715, and 5,335,290 teach dif- 
ferent techniques used to perform optical character rec- 
ognition ("OCR") and are hereby incorporated by 
reference. Indeed, commercially available software 
translates image information into content based infor- 
mation. 

To facilitate the resolution of image signals or data 
into further signals representing content, special print- 
ing fonts are. at times, employed. These fonts include, 
for example, bar codes, OCR-A, OCR-B. and MICR or 
other fonts. The fonts have been specifically developed 
to be recognized by machine vision systems. . That is. 
matter printed in one of these fonts is more easily recog- 
nized than matter printed in other fonts. In a preferred 
embodiment of the invention, recognition engine 20 
detects the presence of a predefined font in printed mat- 
ter and evaluates content based on that information. It is 
noted, however, that most printed matter is also capable 
of being analyzed by recognition engine 20. 

Bar codes, are a special form of information in 
printed matter. Ordinarily, a bar code image has no 
informational content to human beings. Rather, a 
machine is required to read and decode the information 
present in the bar code. Recognition engine 20 of 
QSPU 18 has the ability to recognize and decode bar 
code information. Recognition engine 20 also has the 
capability to optically detect and resolve matter printed 
with Magnetic Ink Character Recognition characters 
("MICR"). MICR, specifically El 3B MICR. for example, 
is a font commonly used by printing operations for print- 
ing checks and other financial information used by the 
banking community. 

Once the printed matter is scanned or read by 
transducer unit 1 2 and these signals have been input to 
QSPU 18 for further processing, the printed matter is 
delivered to an exit roll or sheet feeder 27. Feeder 27 is 
similar to roll or sheet feeder 6. It is contemplated that 
feeder 27, as well as feeder 6, may be dedicated solely 
to feeding sheets or solely to feeding the web of a roll of 
printed matter. However, it is within the scope of the 
invention that a feeder that accepts and delivers both 
discrete sheets and a roll web may be successfully 
employed in the invention. 

Feeder 27 receives printed matter 1 3 and aligns the 
printed matter for delivery to further post printing 
devices (not shown). As discussed above, many com- 
puter printing operations have post-printing or post 
processing devices which perform such operations as 
folding printed matter and/or inserting printed matter 
into envelopes or the like. It is expected that these 
devices and operations will be unaffected by the intro- 



duction of the invention into existing computer printing 
operations. Thus, it is possible for the present invention 
to be integrated into existing computer printing opera- 
tion systems with minimal difficulty. 

5 Turning to Fig. 2. therein is illustrated an example of 

one possible mechanical arrangement of the path of 
printed matter through input and exit feeders as the 
printed matter is presented to a transducer. Fig. 2 illus- 
trates a web 30 of a roll of printed matter, rollers 31 , 32, 

io 37 and 39, a belt drive unit 36, a motor driven wheel 38 
and belt 40. a curved surface 33 and an optical trans- 
ducer 35 with light source and lens 34. 

In Fig. 2, a single continuous web of printed matter 
30 is fed from a printing unit (not shown) and is thereaf- 

i5 ter drawn over a first alignment roller 31 . Roller 31 as 
well as roller 39 and belt drive unit 36 are coupled 
through frictional contact with belt 40 which is driven by 
a motor connected to wheel 38. Thus, belt 40. driven by 
wheel 38, drives belt drive unit 36 which, in turn, drives 

20 another belt in frictional engagement with web 30. This 
action by unit 36 causes the web 30 to progress through 
the system and across the path being scanned by an 
optical reader 35. 

In the embodiment of Fig. 2, alignment rollers 31 

25 and 32 may represent feeder 6 of the block diagram of 
Fig. 1. Rollers 31 and 32 may be adjustable, either man- 
ually or automatically, to reduce or increase tension in 
the web 30. Through the alignment of these rollers, the 
web 30 is forced to follow a path which places the web 

30 30 in a position to be passed directly under optical 
reader 35. 

Optical reader 35 of the embodiment of Fig. 2 cor- 
responds to an optical transducer of transducer unit 1 2 
of Fig. 1 . Associated with the optical reader 35 and com- 

35 prising further elements of the transducing unit are light 
source and focussing lens 34 which focuses light on a 
distinct area of printed matter 30. Although only one 
optical reader 35 is illustrated in Fig. 2, it is contem- 
plated that more than one optical reader may be used in 

40 the invention. For example, to perform full duplex scan- 
ning, additional rollers and an additional transducer (not 
shown) may be positioned to scan the other side of web 
30. 

Belt drive unit 36 moves the web 30 of printed mat- 
45 ter past the point where the printed matter is to be read 
and over exit rollers 37 and 39 to, possibly, a roll take up 
device. Exit rollers 37 and 39 may also be adjustable, 
either manually or automatically, to compensate for var- 
ying web tension. In the embodiment of Fig. 2, exit roll- 
so ers 37 and 38 may correspond to exit feeder 27 of Fig. 
1. Thus. Fig. 2 represents one poss;nle mechanical 
arrangement of parts necessary to pass printed matter 
past an optical transducer. 

Turning to Figs. 3 A through 3E, representative 
55 printed matter and the quality problems associated 
therewith are illustrated. In Fig. 3 A. a representative 
page of printed matter to be inspected in accordance 
with the invention in order to determine jointing quality 
is illustrated. More specifically, Fig. 3A illustrates a fic- 
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tional letter 42 with a logo 43, heading 44, body of the 
letter 45. and a signature block 46. Any areas of letter 
42 may be selected and examined in accordance with 
the invention to determine print quality. However, to 
explain the nature of print quality problems, Figs. 3B-3E 
illustrate only a selected area, heading 44, of letter 42 
which reads "Your Widget Order." 

Fig. 3B illustrates a high quality printing of a 
selected area 44. As explained in more detail below, this 
select area maybe subdivided into constituent parts. In 
Fig. 3B, selected area 44 is divided into twelve equal 
parts that are delineated by lines 45-57. It is assumed 
that a human operator that inspected area 44 as shown 
in Fig. 3B would conclude that the image is printed with 
high quality. 

In contrast to the high quality printing of area 44 in 
Fig. 3B, a human operator inspecting area 44 as shown 
in Figs. 3C-3E would notice several different problems. 
In Fig. 3C, the letter "W in "Widget" appears to be miss- 
ing between lines 50 and 51. The cause of the problem 
illustrated by Fig. 3C may be a printer that is malfunc- 
tioning or a printer that has scrambled or lost informa- 
tion that was supposed to have been printed. 

In Fig. 3D. portions of the T in "Widget" and the "O" 
in "Order" have been obscured by an errant printing 
spot or blob between lines 53 and 55. The cause of this 
spot may be from the printer or from any of the mechan- 
ical transports associated with the system. In any event, 
it represents poor quality because area 44 is .only par- 
tially readable. 

In Fig. 3E. another errant printing spot is illustrated 
in area 44. Although none of the letters of area 44 are 
illegible due to the spot between lines 46 and 51, the 
errant spot reflects poor printing quality which may indi- 
cate larger printing problems. The cause of the errant 
spot may be any of the underlying causes responsible 
for the spot illustrated in Fig. 3D. 

Thus, Figs. 3C-3E illustrate various problems which 
may occur during the printing process. These illustra- 
tions of print quality problems, however, do not repre- 
sent the entire range of print quality problems. There 
are other print quality problem such as character skew, 
streaks, light toner, or poor character shape which are 
not ijlustrated but which represent serious quality issues 
in a computer printing operation that the present inven- 
tion is designed to recognize. 

The print defects represented by illustrations Figs. 
3C-3E, although possible, are exaggerated for effect. If 
a printer consistently-printed with such poor quality, a 
conscientious operator would undoubtedly uncover 
these defects. There are, however, problems in print 
quality that are undetectable even by conscientious 
operators due to limitations of human eyesight. These 
problems, while not affecting the aesthetic presentation 
of the printed matter, nevertheless affect the machine 
readability of the printed matter. That is. printer quality 
problems may adversely affect the printed matter and 
still be undetectable by human eyesight. 

For example, as described above, mailing opera- 



tions sometimes mail invoices to customers and include 
a return slip or remittance slip that is later read by a 
machine, ff the return slip has even human undetectable 
quality problems, the machine may have difficulty read- 

5 ing the return slip. To reduce this type of occurrence, the 
transducer unit and QSPU are capable of resolving print 
quality problems, such as spots, voids and other errors, 
that occur in distances as small as .012 inches. 

Given the foregoing explanation of the system com- 

io ponerrts and typical quality problems, an overall discus- 
sion of the system and method of the invention is now 
possible. Fig. 4 illustrates the general flow of the system 
and method of the invention to determine quality of 
printed matter. The flow of Fig. 4 is separated into two 

is columns. The right column represents the physical 
steps directed to the printed matter whereas the left col- 
umn represents the steps taken by the user and QSPU 
18 as the printed matter passes through the system. 
Step 60 illustrates the beginning of the printing 

20 process. In step 60, it is assumed that a printer interface 
receives a print job. As noted above, this step is not nec- 
essary for the invention but represents a convenient 
starting point for an explanation of a preferred embodi- 
ment of the invention. Printer interfaces, such as inter- 
ns face 4 of Fig. 1 , may control the printer, may only reflect 
information being printed by the printer, or may fall 
somewhere in between these two possibilities. The 
printer 2 and/or the printer Interface 4 may be intercon- 
nected to a network such as a LAN. 

30 Following receipt of the print job. the printer inter- 
face communicates with QSPU 18 and printer 1. These 
communications are represented as steps 61 and 66 in 
Fig. 4. Thereafter, the printer begins to print the job as 
illustrated as step 62, feeds the printed matter to the 

35 quality system as illustrated as step 63, and the status 
console 24 of QSPU 18 displays information about the 
print job as illustrated as step 67. Depending on the 
capability of interface 4, communications between the 
printer and the QSPU 18, steps 61 and 66, may range 

40 from the printer 2 or QSPU 18 passing simple status 
information, i.e. content that the printer 2 is printing or 
that printer 2 should stop printing, to the printer 2 or 
QSPU 18 passing complex print layout information, i.e. 
an indication of the data being printed, the font type, the 

45 location of the printing, and the orientation of the print- 
ing. 

At step 67, status console 24 may display a variety 
of information that QSPU 18 generated via previous 
scans or received via printer interface 4. Depending on 

so user preferences, the status console may display a 
sample of the printed matter, the print job title, the 
source of the print job or the like. A GUI on the status 
console generally permits the user to switch between a 
display of relevant print information to an input mode 

55 where a user may input data and instruction to QSPU 
18 regarding acceptable quality. 

As illustrated at step 68. a user then selects an area 
or areas on the printed matter to be inspected for qual- 
ity. The area to be inspected varies depending upon 
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user preference- The ares -r areas selected by the user 
may contain static irrfor marten, i.e. information that does 
not change from document to document on the printed 
matter, or dynamic information, i.e. information that 
changes from document to document on the printed 5 
matter. Area 42 of Fig. 3 represents a static area 
because it does not change from document to docu- 
ment. Letter 42 of Fig. 3, however, does contain 
dynamic areas such as the inside address, the date, or 
any other substantive aspects of the letter that changes 10 
from customer to customer. 

In one preferred embodiment, the user selects an 
area of each document of the printed matter to be ana- 
lyzed by specifying a physical location. That is, the user 
selects, via the GUI on status console 24, a specific 15 
physical location representing a top, bottom, left and 
right location. It is important to note that the area 
selected by the user may be changed from job to job 
and may be maintained in a library which is stored in 
memory 22. In one preferred embodiment, the area 20 
selected may be changed via data input provided by an 
intelligent interface. 

The area that is selected by the user to be checked 
for quality is stored in memory 22 of QSPU 18 and 
transmitted to the transducer unit 1 2 via two way com- 25 
munication link 17. The associated transducer unit 12 
hardware and software 1 5 then controls a transducer or 
transducers, such as transducer 14 and/or 16, to scan 
the area or areas selected by the user. Depending on 
the instructions transmitted by QSPU 1 8, the transducer 30 
unit 12 then scans the selected area as indicated as 
step 64. If QSPU 18 instructs transducer unit 12 to 
obtain an image or scan the selected area of the printed 
matter, transducer unit 12 returns that information to 
QSPU 18 also via communication link 17. 35 

At step 69, an operator provides information to 
QSPU 18 via status console 24 on acceptable quality for 
the user selected area. The quality limitations indicated 
by the user at step 69 include information such as con- 
firming the print quality of the data printed and the loca- *o 
tion.that the data is printed. The user may also specify 
an exemplar, in the form of a data structure, to use tn a 
first level quality check. In a preferred embodiment, this 
quality information is passed to QSPU 18 as a data file 
stored in memory. 45 

In one embodiment of the invention, quality is veri- 
fied against preset quality criteria. That is, the operator 
may not vary the criteria that QSPU 18 uses to deter-* 
mine a quality defect. In this embodiment, however, an 
operator still inputs a quality error limit at step 69 that so 
indicates the maximum number of quality defects that 
are acceptable to the operator. For example, the opera- 
tor may specify a threshold of two detected errors within 
a thousand scanned lines or fifty detected errors within 
one hundred scanned lines. If this number of quality ss 
defects or "error limit" is exceeded, the system reports a 
condition of poor quality. Thus, the operator must input 
to the system, at step 69, the human acceptable quality 
and thresholds in the form of error limits. 



In an alternative embodiment, an operator selects 
quality criteria at step 69 by selecting one of two or more 
preset quality criteria options possibly in addition to set- 
ting an error limit. In this embodiment, two or more qual- 
ity criteria options reside in QSPU 18 and these options 
work in conjunction with recognition engine 20 to detect 
quality problems. The options may search, for example, 
for quality defects using a "hard," "medium,'* or "soft" 
standard. In the "hard" standard, a void or spot may be 
minor relative to the "medium" or "soft" options and still 
qualify as a quality defect. Conversely, voids or spots 
that may not qualify as quality defects in the "soft" option 
may qualify as quality defects in the "medium" or "hard" 
options. Thus, in this embodiment, the operator may 
input, at step 69, an error limit and the quality threshold 
used to determine a quality defect. 

In yet another embodiment, an operator selects 
quality at step 69 by accepting or rejecting printed mat- 
ter presented to the operator by QSPU. 18. In this 
embodiment, QSPU 1 8 may have preset quality criteria 
or may have little or. perhaps, no initial quality criteria. 
As the system begins to scan printed matter, it presents 
printed matter of questionable quality, depending on the 
initial qualrty criteria, to the operator for verification. The 
operator then indicates that the quality is acceptable or 
that it is rejected. In this embodiment, the quality thresh- 
olds are learned over time. This embodiment may use 
neural networks or other artificial intelligence tech- 
niques to "learn" acceptable from non-acceptable qual- 
ity. Further, it is noted that given the teachings of this 
specification, a person of ordinary skill may combine 
portions of any of the above contemplated embodi- 
ments in conjunction with portions, of other embodi- 
ments to form yet additional quality input options. 

After the user has selected an area, step 68, and 
input acceptable error limits or quality thresholds, step 
69, and after the selected areas have been scanned by 
the transducer unit and the image data returned to the 
QSPU. step 64, the QSPU processes the image data to 
determine, decision 71. whether the quality meets or 
exceeds the preset thresholds or thresholds set by the 
operator. 

If, based on preset or operator input qualrty thresh- 
olds. QSPU 18 determines that the quality is accepta- 
ble, QSPU 1 8 determines that the printing is acceptable 
and the process continues at step 72. On the other 
hand, rf QSPU 18 along with its recognition engine 
determines one or more quality defects, QSPU 18 must 
also verify that the number of quality defects does not 
exceed the error limit set by the user at step 69. If the 
number of quality defects is below th? error limit, QSPU 
18 determines that the printing is acceptable and the 
process continues at step 72. However, rf the number of 
quality defects exceeds the error limit QSPU 18 com- 
municates, step 66. wfth the printer and informs the 
printer to cease printing. 

If the quality is acceptable or rf the number of quality 
defects is below the error limit, the printer continues to 
print the job, step 62, the printed matter is fed to the 
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quality system, step 63, selected areas are continually, 
scanned, step 64, and the printed matter is fed out of 
the system and continued to post-printing devices, step 
65. as described above. It is noted that the steps illus- 
trated in Fig. 4 are meant to provide a conceptual under- s 
standing of the invention. As implemented, other steps 
may be performed or the steps may be performed in a 
different order. 

Rg. 5 illustrates the specific steps undertaken by 
QSPU 18 to determine whether the printed matter satis- w 
fies the user input acceptable quality limits. In a pre- 
ferred embodiment, three quality level checks are 
undertaken to ascertain quality: a first level, or rough 
level, is illustrated as steps 81-83; an intermediate level 
is illustrated as steps 84-85; and a final feature level is is 
illustrated as steps 86-87. 

In the first level, the scanned data is segmented into 
discrete areas. This step may be performed by seg- 
menting the scanned area into discrete physical areas 
as illustrated the areas between the lines 40-52 of Figs. 20 
3B-3E. This step of segmentation may also be per- 
formed by recognition engine 20 which segments the 
scanned areannto boxes around each character. 

In one preferred embodiment, data segmentation is 
performed as follows. A frame signal image of the 25 
selected area is produced by the transducer unit 1 2 and 
is transmitted to QSPU 18 via communication link 17. 
QSPU 1 8 receives the signal through a port and stores 
the scanned area in memory 22. The scanned {mage is 
. stored in QSPU 18 memory as a series of points or pix- 30 
els. Thereafter. QSPU 18 has an area of memory 22 
corresponding to the scanned image with at least a sin- 
gle bit indicating a 1 or a 0 for each pixel and represent- 
ing whether each pixel is on or off. To perform color 
scanning and storage, memory 22 stores more than one 35 
bit for each pixel depending on the color resolution 
desired. 

. After the scanned image is stored in memory, rec- 
ognition engine 20 compares pixels that are on with pix- 
els that are off. If an area of memory corresponding to *o 
the scanned image has a threshold number of off pixels, 
recognition engine 20 assumes a white space and seg- 
ments the area. Likewise, if an area of memory indi- 
cates contiguous or neighboring on pixels, recognition 
engine 20 assumes the presence of a character and 45 
also segments the area. In such fashion of comparing 
on pixels to off pixels, recognition engine 20 is able to 
segment the scanned area of memory into characters 
and white space. This process of segmentation is illus- 
trated in Fig. 5 as step 81 . so 

Following segmentation, QSPU 18 checks the seg- 
mented characters against an exemplar. The exemplar 
may take the form of selecting or indicating the font of 
the scanned area to QSPU 18. QSPU 18 then retrieves 
information about the font from another area of memory ss 
22 or from a stored library which may also reside in 
memory. This retrieval of information is generally illus- 
trated as step 82. After the font or other information is 
obtained, step 82, QSPU 18 determines an appropriate 



height, width, and permissible skew angles for the seg- 
mented area. QSPU 18 through recognition engine 20 
then ascertains the height width and skew angles of the 
segmented data. If the segmented characters fit 
retrieved height and width and skew angle specifica- 
tions, the characters pass the first level quality verifica- 
tion. If the characters do not fit the height and width 
specifications, they are unrecognized and fail the first 
level verification. This step is globally illustrated as deci- 
sional 83. 

The segmentation of data and the first low level 
quality check assists QSPU 18 in locating quality errors 
such as skew, poor image quality, spotting and streaks. 
If a segmented character has too few or too many on 
pixels, QSPU 18 concludes that one or more of these 
potential problems exists on the printed matter. 

If the first or low level test is failed. QSPU 18 
attempts to determine the nature of the print error as 
indicated at step 88. QSPU 18 may perform this step by 
referring to an error log and a data structure. Every time 
QSPU 1 8 detects an error, it logs the error in an error 
file, step 89. The error log or file is a separate file stored 
in memory 22. This file is available for user review via 
status console 24 and for QSPU 18 use in generating 
separate data structures which relate to all printing 
errors. 

A user may add information to the error file that aids 
QSPU 18 to determine the nature of the quality prob- 
lem. For example, if a user recognizes that skewed 
images failed the low level test based on a certain pat- 
tern, the user can add that information to such failures in 
the error log. Thereafter, if QSPU 18 recognizes a simi- 
lar pattern after referencing the error file, QSPU 18 can 
inform a user via status console 24 of the nature of the 
error. 

After the error file has been updated with the error, 
step 89, QSPU 18 may communicate the quality prob- 
lem to the printer interface 4 via communication link 25. 
If printer 2 has an intelligent interface, QSPU 18 may 
pass to the interface an instruction to stop printing and 
other information regarding the nature and type of error. 
If printer 2 is able to vary or adjust certain printing 
parameters in order to affect or improve print quality, the 
QSPU 18 may pass to the interface an instruction to 
vary such parameters sufficiently to rectify or mitigate 
any quality problems detected. This may provide auto- 
matic, closed-loop control over print quality. 

As noted above, if QSPU 18 determines that an 
error limit has been exceeded, it also determines that 
the printer must cease printing. This decision is indi- 
cated as decision 91 in Fig. 5. To make this decision, 
QSPU 18 retrieves the user input stored quality informa- 
tion, compares this limit information to the number of 
errors detected and commands the printer interface 4 to 
cease printing, step 92. if the number is exceeded. On 
the other hand, if the print quality error is within accept- 
able limits, the process continues, step 95. 

The first level determination is designed to be a 
rapid check on the quality of the data. If the quality fails 
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the first step, additional quality checks are unnecessary. 
On the other hand, if the printed matter satisfies the first 
quality check, additional checks are still necessary. 

The second level check on quality is indicated as 
steps 84-85. In step 84. QSPU 18 performs high level s 
recognition of the selected area using its recognition 
engine 20. This step is similar to the first level check but 
involves a more specific analysis of the segmented data 
or characters. Among other things, this second level 
check insures that the printer is printing accurate data in io 
an accurate location. The data recognized at step 84 
may be bar code information, MICR or OCR. 

QSPU 18 performs the second level check by 
selecting 20 to 30 locations each having 1 to 5 pixels of 
the segmented data and comparing this information to is 
stored or user input font information. At this level, QSPU 
1 8 may attempt to verify every scanned character or it 
may select representative characters to analyze. Loca- 
tions both inside a character and in the white space sur- 
rounding the character are analyzed. QSPU 18 20 
performs a comparison between the on and off pixels of 
a sample or exemplar font with the on and off pixels of 
the scanned area. If the comparison yields differences 
that are less than or withircpreset or user input thresh- 
olds, the second level check is satisfied and QSPU 1 8 25 
will proceed to the third level check. On the other hand, 
if the comparison yields differences that exceeds quality 
thresholds, QSPU 18 proceeds to the steps described 
above for a failure of the first level check. The decision 
on the second level check is indicated as decisional 85. 30 

During the second level check, a QSPU 18 of one 
embodiment of the invention also compares the 
detected character data to the expected data for that 
location. H the scanned area is a static area, QSPU 18 
searches its memory to determine the expected data to 35 
be printed and compares this data for a match. On the 
other hand, if the scanned area contains dynamic or 
variable data, QSPU 18 has to receive data that is 
expected to be printed from printer interface 4 or from 
another source. In either case. QSPU 18 compares the 40 
scanned data with the expected data and, if any differ- 
ences exist, identifies a quality problem at the second 
level. _\l 

If the second level check results in a conclusion of 
acceptable print quality. QSPU 18 initiates a third and 45 
final check on print quality. The third check is indicated 
at step 86. In this step, QSPU 18 selects approximately 
5 to 10 locations each having 1 to 5 pixels in height and 
width. These locations- are also within the character and 
the surrounding white space. As in the preceding steps, so 
QSPU 18 compares the segmented locations with an 
exemplar to determine if the user input quality thresh- 
olds are exceeded. 

The function of the third level check is to determine 
whether spurious voids, spots, streaks or blobs are ss 
present in the printed matter. This step is undertaken 
even though the placement and content of the printed 
matter has been verified as accurate. Thus, the third 
level inspection is undertaken specifically to determine 



quality problems not human readability problems. Deci- 
sional 87 indicates that if QSPU 18 determines that the 
third level test is not satisfied. QSPU 18 follows the 
same steps, i.e. steps 88-92. that it would follow if the 
first or second level tests were failed. If the third level is 
passed, the process continues, step 95. 

Figs. 6A-6C are useful illustrations to explain the 
three step quality detection system and process. Turn- 
ing first to Fig. 6A, therein is illustrated a numeral "2" as 
element 101. In the first step of the three step system, 
QSPU 18 and recognition engine 20 separate the 
numeral "2" 101 from white space as indicated by box 
100. Next. QSPU 18. through processor 19 and recog- 
nition engine 20 determine the height 103 and width 
104 of the numeral. Processor 19 and recognition 
engine 20 also determine a skew angle. In Fig. 6A, the 
skew angle is indicated by the Greek letter alpha ("a") 
as element 106 or, alternatively, by the Greek letter 
theta ("6") as element 1 05. Processor 1 9 and recogni- 
tion engine 20 may perform this skew determining step 
as described above and/or through any techniques that 
are known in the art such as those described in United 
States Patent 5,355,420, which is hereby incorporated 
by reference. 

After the height, width, and skew are determined, 
processor 19 and recognition engine 20 compare these 
basic physical characteristics with information stored in 
memory 22 to determine if these characteristics match 
a known font and, if so, are within either prestored or 
user selected tolerances for that font If the character is 
within the tolerance for a recognized font for height, 
width and skew angle, processor 19 and recognition 
engine 20 proceed to the second level. If not. processor 
19 and recognition engine 20 log a quality defect in 
memory 22 and compare the number of quality defects 
to the user selected error limit. If the limit is not 
exceeded, processor 19 and engine 20 proceed to the 
second level. If the error limit is exceeded, QSPU 18 
concludes that the printer is printing poor quality and 
causes the printer to cease printing. 

Fig. 6B illustrates a potential second level check. In 
Fig. 6B. it is assumed that the same numeral 2 from Ftg. 
6A. i.e. element 101. has passed a first level quality 
check. In Fig. 6B, several areas, i.e. 110 through 1 15, of 
the numeral are examined to determine the identity of 
the character and the quality of the character. Although 
only six analysis areas are indicated on Fig. 6B for brev- 
ity. QSPU 18 may inspect fewer or more locations. 

By selecting these analysis areas and counting the 
number of on and/or off pixels in these area, processor 
19 and recognition engine 20 may accurately identify 
the character as well as potentially identifying quality 
defects. This is usually, but not necessarily, accom- 
plished by considering the number and locations of on 
and/or off pixels and comparing this information with 
information stored as a data structure that relates a 
unique number of pixels in an analysis area to a unique 
character. Once the states of the pixels in the analysis 
area are known, a Hook-up" process on the data struc- 
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ture identifies a unique character for that pixel pattern - 
for all analysis areas, ft is noted that certain analysis 
areas, such as area 112, are in white space, certain 
analysis areas, such as area 1 1 5. are located entirely 
within the character, and certain analysis areas, such as s 
area 111. span white space as well as character space. 
This second level quality check, therefore, identifies the 
data content of the separated character. 

Processor 1 9 and recognition engine 20 log a qual- 
ity defect if a unique character cannot be determined. io 
Moreover. QSPU 18 may log a quality defect for each 
non-matching analysis area. As in the first level check, if 
the number of quality defects exceeds the user input 
error limit. QSPU .1 8 causes the printer to cease print- 
ing. 15 

Finally, as illustrated in Fig. 6C. a third level check is 
performed. This check is similar to the second level 
check but is performed on different analysis areas, i.e. 
120-124. than those areas used to determine the iden- 
tity of the character in the second level quality check. 20 
White space areas, such as areas 121-123, are 
checked to determine that the number of on pixels does 
not exceed a- preset threshold. Analysis areas entirely 
on the character or overlapping the character are also 
checked to compare on pixels with a known threshold 2s 
for those pixels. If the number of on pixels differs from 
the threshold, QSPU 18 logs a print quality defect As in 
the case of the first level and second level checks, if the 
number of quality defects exceeds the user input error 
limit, QSPU 18 causes the printer to cease printing. 30 

The three step process of the invention to deter- 
mine quality of printed matter provides a fast and effi- 
cient mechanism to determine print quality. By its 
nature, the invention can process scanned data rapidly 
to maintain pace with high speed printers and the anal- 35 
ysis can accommodate a wide variety of fonts and print 
faces. Moreover, the process is flexible because it per- 
mits various analysis areas and thresholds to be applied 
to the quality determination. 

Fig. 7 A is an illustration of another page of printed <o 
matter that may be analyzed in accordance with the 
invention. Printed form 130 represents an insurance 
disbursement with a top portion indicating a description 
of services along with the amount of the disbursement 
and a bottom portion below a dotted perforation line that 45 
includes a sample negotiable check portion. The top 
portion includes a logo 131, an inside address, 132, a 
deductible amount 133. a benefit portion 134, and an 
account number 135. The bottom check portion 
includes a standard check with an account number 136 so 
printed in MICR. Fig. 7A thus differs from Fig. 3A by 
including printed areas that are printed by more than 
one printer, ie. an impact MICR printer for printing the 
account number on the check portion in MICR and a 
non-impact printer for all other areas. 55 

It is important that the MICR printer print informa- 
tion on the check that corresponds to information 
printed by the non-impact printer on the remainder of 
the page. Frequently, however, the MICR printer loses 



synchronization with the non-impact printer and prints 
MICR lines that do not correspond to the remainder of 
the document Through the system and method 
described above, the invention is able to detect such an 
erroneous printing and is able to alert the operator 
and/or cause either printer to stop printing. 

Fig. 7B is an expanded view of the area corre- 
sponding to the non-impact printed matter account area 
135 of printed form 130. Fig. 7C is an expanded view of 
the impact MICR printed matter account area 136 of 
printed form 130. These two areas are illustrated 
because they are suitable areas for an operator to 
select to check for quality of printing between the two 
different types of printers. 

An operator using the inventive system and method 
selects areas 1 35 and 1 36 through a GUI on status con- 
sole 24 to be analyzed for quality. The operator, also 
through status console 24, indicates to QSPU 18 to 
compare the two account areas 1 35 to 1 36. Thereafter, 
the system scans the account areas, processes each 
area, i.e. with the three step detection system and 
method, and ascertains at least the identity of each 
character in the account area. QSPU 18 through proc- 
essor 19 then compares a first printer account area, 
135, with a second printer's account. area. 136. If the 
content of the two areas differ,, QSPU 18 will cause one 
or both printers to cease printing. 

By performing the quality verification rapidly. QSPU 
18 may verify differing areas on every page, even at a 
high printing rate, and inform an operator of the results 
via status console 24 or other annunciator. It is noted 
that this application of the inventive system and method 
is not limited to systems involving an impact and non- 
impact printer. Any operation with more than one printer 
has a potential to fall out of synchronization. These sys- 
tems with two or more printers, including duplex printing 
operations using tandem simplex printers, will benefit 
from the ability of the present system and method to 
rapidly recognize characters, compare those characters 
and cause the printers to cease printing when they fall 
out of synchronization. 

. Non-font images such as logo 43 in Fig. 3 A can be 
quality verified by employing a modification of the tech- 
nique described above. First, the logo 43 or a part 
thereof may be segmented. Segmentation may be 
accomplished by dividing the selected area based upon 
a grid of rectangles, for example, or as described in any 
of the above referenced issued United States patents: 
Each rectangle includes an array of pixels, such as a 30 
by 30 array of pixels. Each rectangle, or each of certain 
selected rectangles, is compared to an exemplar bench- 
mark. The comparison may be made by summing the 
number of on pixels in the rectangle and comparing the 
sum to the sum of on pixels in the preset or user input 
exemplar benchmark. If the number of pixels in the rec- 
tangle differs from that of the exemplar benchmark by 
more than a predetermined amount, then a print quality 
error is logged. The predetermined amount of permissi- 
ble variation may itself be a function of the number of on 
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pixels. Thus, a rectangle that is supposed to be all white 
may be logged as an error rf just two pixels are black, 
where a rectangle that is roughly half white and half 
black may require a greater number, for example 10, of 
incorrectly printed pixels for an error to be togged. This 5 
variable threshold corresponds with the varying sensi- 
tivity of the human vision system to errors under differ- 
ing circumstances. 

Fig. 8 illustrates a possible physical arrangement of 
the computer printing operation employing the present to 
inventive system and method. Fig. 8 illustrates a roll 
feeder 150 with blank roll 151 feeding a web 153 into a 
printer 155. Printer 155 prints onto web 153 and feeds 
the printed matter 156 into a physical housing 157 that 
contains QSPU 1 8 and optical transducer unit 1 2 of Fig. 15 
1 . The transducing of the printed matter and processing 
is performed in housing 1 57 and information regarding 
the processing is output on monitor 1 58 comprising at 2. 
least a portion of status console 24 of Fig. 1 . Processed 
printed matter 1 59 is then fed onto an exit roll feeder unit 20 
160 as roll 161. In this possible physical arrangement, 
roll feeders 150 and 160 correspond respectively to roll 3. 
unit 6 and exit roll unit 27 of Fig. 1 . However, as pointed 
out in Fig. 2,. roll unit 6 and roll unit 27 of Fig. 1 may also 
correspond to rollers within housing 157 comprising 25 
part of a feed path before and after the transducing of 4. 
the printed matter. 

The advantages of placing the inventive system 
and method into a physical arrangement such a.s that 
illustrated in Fig. 8 are significant. A computer printing 30 
operation may operate in true "roll to roll" fashion with a 5. 
high degree of confidence that the printer is printing 
high quality, accurate output. By operating with the 
inventive system and method, computing printing oper- 
ations reduce waste and printing down-time by quickly 35 
alerting operators that printing errors have occurred. 
Moreover, by running printers with fewer operators and 
by running printers for greater time periods without 
operator interruptions to verify quality, owners of expen- 
sive printers can dramatically increase their printed out- • <o 
put and revenues. This increase in revenue helps 
increase the rate of return on a costly investment such 
as a high speed printer. 

Other objects, features, and advantages of the 
present invention will be more readily apparent upon 45 
reading the above description. It should be understood 
that the detailed description and specific embodiments 
are given by way of illustration only, since various 
changes and modifications within the spirit and scope of 
the invention will become apparent to those skilled in so 
the art from this detailed description. 

Claims 

1 . A method for analyzing output of a printer compris- ss 
ing the steps of: 

a. determining at least one select area of 
printed matter to be analyzed; 



b. controllably feeding said printed matter past 
at least one optical transducer; 

c. controlling said at least one optical trans- 
ducer to produce electrical signals representa- 
tive of said at least one select area of said 
printed matter; 

d. storing said electrical signals in a memory; 

e. processing said electrical signals to produce 
further electrical signals representative of dis- 
crete regions of said select area; 

f. providing a human acceptable quality limit; 

g. comparing said further electrical signals with 
said quality limit to determine if said electrical 
signals fall below said quality limit; 

h. generating at least one output signal based 
on the outcome of said comparing step. 

The method in accordance with claim 1 further 
including the step of controlling said printer based 
on said output signal. 

The method in accordance with claim 1 further 
including the step of displaying output on an opera- 
tor status console based on said output signal. 

The method in -accordance with claim 1 wherein 
said step of determining at least one select area 
and said step of providing a quality limit is per- 
formed by a human operator. 

The method in accordance • with claim 1 wherein 
said step of determining at least one select area 
and said step of providing a. quality limit is per- 
formed by a computer. 



12 



EP 0 772 145 A2 




13 



EP0 772 145 A2 




i 



14 



EP0 772 145 A2 



1 i 



-M3 



BRASS 
WIDGETS. INC. 

NEW YORK, LOS ANGELES. HONG KONG 



Aw 7. 1993 

Mr. John Smith 

QiiefBuyo- 

ABC- 12 Corporttioa 

Qoc^o, L 6060 1 



fie W^-U«r 



Dear Mr. Scnkh: 



TTwA: you for yor ord* Dumba- 9999 for our brm* wxlgea. LWbrcun*teK/. your 
ihiprax*. bm Vti defaryod boauu thk tag ■ out of stock. W e hope to ihjp within (he 
noa 30 dty*. We ^obgxzc for the dcUy «k1 «y moonvwuenoe (ha corny emit vou. 



*e wOl ihip your order m voon mk a cwbblc. If you \**h la caned ywr order, ptcme 
let us know end uc \*ifl arrmgc a round or credit, ^hichevw you prefer. 

Agui vk yotog g e for the dcUy. 

-in -"^ 

John W. Doc 

Accouit Rcprocnutivo 



FIG. 3A 



45 41, V£J V? 5, Ji iz 5i S u i 35 5 * J?' 



r 



FIG. 3B 



15 



EP 0 772 145 A2 



IT 

















• 

* 


Yc 


Ul 


• 


id 


%et C 
















Mill 





FIG. 3C 



57 51 3T £ 



Re 



Widg\^)de^ 



FIG. 3D 



45 <i'o '-'3 5« J"' 




FIG. 3E 



16 



EP 0 772 145 A2 



QSPU Receives 
Scanned Data 



T 



■0» 



Scanned Data Is 
Segmented 



i 



Obtain Library 
Information 




Perform High Level 
Recognition 




Perform Feature 
Quality Checks 



-fa 




FIG. 5 



Determine Nature Of 
Print Error 



I 



Add Error 
Information To Error 
History File 




Yes 



Inform Interface To 
Stop Printing - 
Display Error 



10 



^Continue ^ 



18 



-4 



EP 0 772 145 A2 



Printer Interface 
Receives Print Job 



User Determines 
Acceptable Quality 
and Thresholds 



0 



Selected Areas of 
Printed Matter 
Scanned 



QSPU 
Communicates With 
Printer Interface 


-4 


Printer Interface 
Communicates with 
QSPU and Printer 






f 




■ i 


f 


Quality System 
Status Console 
Displays Information 




Printer Receives 
Instruction and 
Prints Job 


i 






i 




User Determines 
' Areas To Analyze 
On Printed Sheets 




Printed Matter Fed 




To Quality System 


' i 


i 


'♦v 


i 





LI 







QSPU Analyzes 


' 


Scanned Data 





QSPU - Is 
Printing 
Acceptable?^ 



c 



Continue 



) 



YES 


Printed Matter Fed 
Into Exit Sheet 
Feeder/Align 













■4/ 



FIG. 4 



17 



EP0 772 145 A2 




19 



EP 0 772 145 A2 



JGfTIC 

7^0 (<2IH tSOl AVQNUt 



I3\ 



Mopd ! 
762 S. UngWo- Cm 



/31- 



EXPUNAT10N CF BENEFITS 



DATE | EMPLOYS / INSURED 


| PATIENT 


CZGUP NUMBER 


CLAIM NUMBER 


11/6/95 | M^idri^TTOTn 


Smen Esranarn 


1201 -363636 


| 112321*2-: 


1 1 1 1 










Pru» 


ProW«r tD 9 | 


Dans at S*r>x» 




Cr. U. 'good 


23-2773890 | 


I0/T5/95 




1 


1 


1 




1 224 W. Cog. <bW 

Morviiwd.1 6C012 









[ 'ohm C-.cr5» I P^wiwQiiesunt | NcfG»«Ho' | 



I 



Guesnpiu? Call 800-272-3770 Mon * Fri 3:00 AM - 5:00 PM EST 



^2 I ico.:o| ( S320.35 ] 



113 



JQT LIFE ie CASUALTY 

l> SL'TUNCS COM P ANTT 



Nov^mbw-j 19 3 5 



I3H 



212: 



PAT TO THE 0RDH OP -Mend arenani 

Eem HvndrW Thirty end «if iiw rrvnartc'^t coilcn 



a:a.ss 



RR5T NATtCNAt SANK 
123 rrnf S*w* 
A/ryw-fi. USA 



FOR 



r 



VC ! 0 N'C N V 2CC TA 211 



hzcccqc z ;a<: 



FIG. 7A 



20 



EP 0 772 145 A2 




EP 0 772 145 A2 



FIG. 7B 



3RD 2 3 U 5 

FIG. 7C 



(19) 



(12) 



Europaisches Patentamt 
European Patent Office 
Off ice europeen des brevets (11) EP 0 772 145 A3 

EUROPEAN PATENT APPLICATION 



(88) Date of publication A3: 

24.02.1999 Bulletin 1999/08 

(43) Date of publication A2: 

07.05.1997 Bulletin 1997/19 

(21) Application number: 96117614.6 

(22) Date of filing: 04.1 1.1996 



(51) int. a. 6 : G06K 5/02, G06K 9/00 



(84) Designated Contracting States: 


(72) Inventor: Esfahani, Majid H. 


CH DE DK ES FR GB IT LI NL SE 


Buffalo Grove, Illinois 60089 (US) 


(30) Priority: 06.11.1995 US 554669 


(74) Representative: 




von Samson-Himmelstjerna, Friedrich R., Dipl.- 


(71 ) Applicant: JOHNSON & QUIN, INC. 


Phys. et al 


Niles, IL 60648 (US) 


SAMSON & PARTNER 




Widenmayerstrasse 5 




80538 Munchen (DE) 



(54) System and method for determining quality of printed matter 



(57) An apparatus and method for determining print 
quality of a printer wherein printed matter is controllably 
presented to an optical transducer unit which scans 
user or machine selected areas of said printed matter to 
generate a signal that is processed by a processing unit 
to determine print quality. The processing unit proc- 
esses the signal in an efficient and rapid three step 
method in which the signal produced by the transducer 
unit is modified and segmented to determine general 



characteristics, recognized by a recognition engine and 
finally checked for voids, spots, blobs or the like. The 
invention provides an operator with the ability to set 
quality thresholds such as an acceptable number of 
quality defects in a single scan. If the number of quality 
defects exceeds the user input quality limit, the proces- 
sor unit determines that the printed matter is poor qual- 
ity and may cause the printer to cease printing. 
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